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The Longitudinal Evaluation of School Change and Performance 
followed the progress of students in high-poverty schools as they moved from 
third to fifth grade, investigating the impact on student achievement of 
specific classroom practices fostered by school-, district-, and state-level 
policies. This analysis, conducted between 1996-99 as part of the National 
Assessment of Title I, tested the effects of changes in curriculum and 
instruction recommended by advocates of standards -based reform. It used data 
from standardized achievement tests, teacher surveys, district administrator 
and principal surveys, focus groups of school staff and parents, classroom 
observations, state and district policy statements, and student records. 
Poverty negatively influenced students' performance. Students made greater 
gains in reading and mathematics when teachers rated highly their 
professional development in reading and mathematics. Low-achieving students 
made faster gains in reading and mathematics when third grade teachers 
actively reached out to their parents. Students whose fifth grade teachers 
spent significant time engaged in very basic reading instruction made fewer 
gains than students whose teachers spent only average amounts of time in very 
basic instruction. Implementing reforms involving more student -initiated 
activities and more complicated assignments in mathematics had a positive 
effect on student achievement. (SM) 
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THE LONGITUDINAL EVALUATION QF SCHOOL CHANGE 
AND PERFORMANCE (LESCP) 

IN TITLE I SCHOOLS 



Overview 

The Longitudinal Evaluation of School Change and Performance (LESCP) followed the 
progress of students in 71 high-poverty schools as they moved from third to fifth grade. The study was 
designed to investigate the impact on student achievement of specific classroom practices fostered by 
school-, district-, and state-level policies. This longitudinal analysis, conducted between 1996 and 1999 
as part of the National Assessment of Title I, especially was intended to test the effects of changes in 
curriculum and instruction called for by advocates of standards-based reform. Many of these changes 
were being made in the wake of the 1994 Amendments to Title I of the Elementary and Secondary 
Education Act, which called on states to adopt challenging academic standards and assessments aligned 
with these standards by 2001. 

Like previous research on Title I, this study clearly demonstrated that student and school 
poverty adversely affected student achievement in both reading and mathematics. Although most Title I 
research has sought to identify school practices that can improve student achievement, this was the first 
major study to examine the impact of standards-based reform practices on student achievement. Students in 
the LESCP schools, on average, did not catch up with national norms during the course of the study. The 
data analysis, however, revealed certain school practices and standards-based policies that were more likely 
to result in student achievement gains as students moved from the third grade through the fourth and fifth 
grades Not all school practices and standards-based policies studied were clearly linked with student 
achievement gains. 

The study found that reading achievement improved faster when two factors were present: 

• Teachers gave high ratings to their professional development in reading. The 

growth in student test scores between grades three and five was about 20 percent 
greater when teachers rated their professional development high than when they gave 
it a low rating. 

• Third-grade teachers were especially active in outreach to parents of low- 
achieving students. Growth in test scores between third and fifth grade was 50 
percent higher for those students whose teachers and schools reported high levels of 
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parental outreach early than students whose teachers and schools reported low levels 
of parent outreach activities for the third grade. 

Conversely, reading achievement was less likely to improve when fifth-grade teachers spent 
considerable time engaged in basic instruction such as filling out worksheets or reading aloud. Growth in 
test scores was 10 percent lower when teachers spent a lot of time on basic instruction than when they 
spent little time engaged in these activities. 



Factors that positively affected mathematics achievement gains were the following: 



Teachers who highly rated their professional development in mathematics. 

Growth in test scores between grades three and five was 50 percent higher for those 
students whose teachers and schools rated their professional development high than 
when they gave it a low rating. 

Early teacher outreach to parents of students who initially showed low 
achievement. Test scores in mathematics grew between the third and fifth grade at a 
40 percent higher rate for students in schools whose teachers reported high levels of 
parental outreach than students in schools whose teachers reported low levels of 
parental outreach activities 

Instructional practices that involved students in more exploration in upper 
grades. Growth in test scores between the third and fifth grades was about 17 percent 
greater for students whose fifth grade teachers reported relatively very high usage of 
exploration in instruction versus students whose fifth grade teachers reported 
relatively very low usage. 



On the other hand, students’ mathematics scores fell further behind when their schools had 
disproportionately more low-achieving students and teachers were relatively satisfied with their own 
instruction skills. Teachers' use of standards and assessments had inconsistent effects on mathematics 
achievement. Students’ gain scores were lower than the LESCP average in schools where teachers 
reported knowing and using standards and assessments. One interpretation of these findings is that 
schools that initially paid the highest level of attention to standards and assessments might have been the 
schools where poor student performance was a problem. 



Achieving higher levels of implementation on the significant variables can have important 
impacts for student achievement growth. For example, in mathematics, the 2-year gain would be 18 
points higher if both the student's own teacher and the average of all teachers in the school gave very high 
ratings to professional development (at the 90th percentile for all teachers and schools in the sample) as 
opposed to very low ratings (at the 10th percentile). An 18-point differential is sizable compared with a 
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46-point average, 2-year gain in mathematics for all schools. For the variable of outreach to the parents 
of low achievers, the 90th to 10th percentile differential would translate into a 17-point gain for students 
who were initially low achieving. 



Background 



Title I is the major federal program designed to improve learning and achievement among 
elementary and secondary students in high-poverty schools. Where poverty is at least 50 percent, the 
school may use Title I funds for schoolwide improvements benefiting its at-risk students. The 1994 
amendments to Title I were enacted to help students who are failing, or most at risk of failing, to meet 
challenging academic standards. The amendments charged states with developing or adopting challenging 
standards for what students need to learn and at what level of proficiency. To measure how well students 
and schools are meeting these standards, states also must administer assessments aligned with these 
standards. Like other federal education policies, Title I does not prescribe how to raise student 
achievement; rather, its impact depends on how states and districts reform curriculum and instructional 
practices to meet their academic standards. When this study began in 1996, few states, districts, or 
schools had begun to implement standards-based reform programs, much less demonstrate their 
effectiveness. Consequently, measurable effects on student achievement could only be expected in 
schools and classrooms that had instituted reforms at least several years earlier. 

Because of this, the schools selected for this study were not intended to be statistically 
representative of high-poverty schools at the national or the local level. The 71 schools, all of which 
received Title I funds as high-poverty schools, were in 18 school districts in 7 states where standards- 
based reforms, including assessments and accountability provisions, either were under way before 1996 
or began while the study was in progress. Although all of the schools were affected by reform policies 
involving standards, assessments, and accountability, the policies and the speed and thoroughness of 
implementation varied. Nonetheless, because these schools had been putting reforms into practice for 
some time, their experiences provided a good picture of how standards-based reform has played out in 
high-poverty schools and offer valuable lessons about standards-based practices that can improve student 
achievement. 



Of the 71 schools, 59 were operating schoolwide programs in 1998-99, in which Title I 
funds can be used for the benefit of all students rather than being targeted to selected students. This 
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reflected, in part, the high-poverty levels of participating schools (see Figure 1): 15 schools had more 
than 90 percent of their students living in poverty, 25 schools had between 75 percent and 90 percent, 
21 schools between 50 percent and 75 percent, and 10 schools fewer than 50 percent. In all schools, the 
poverty rate was higher than 35 percent. 

Figure 1. Poverty level of schools in the LESCP sample (n=71) 




Percentage of students eligible for free or reduced-price lunch 

*In all LESCP schools, the poverty rate was higher than 35 percent. 

School and Classroom Variables 

This study drew on several sources of data: standardized reading and mathematics 
achievement test scores, 1 teacher surveys, district administrator and principal interviews, classroom 
observations, focus groups of school staff and parents, and documents regarding school districts’ policies 
related to standards-based reform. It traced the students’ achievement scores and examined the effect of a 
number of student and school-level variables involving school practices, teacher preparation, and reform 



1 The SAT-9 scores provided a uniform measure of student scores and gains across the whole sample, enabling the study team to make 
comparisons among all the schools and classrooms. Because Title I emphasizes attainment of state standards, however, the SAT-9 would not be 
a good choice for this purpose if it measured content that was not closely related to the states’ own expectations for students. Therefore, the 
study team used data from state assessments to gauge whether student performance on the SAT-9 had a reasonably good relationship to 
performance on the knowledge and skills that the states were measuring. The researchers correlated schools' performance on the SAT-9 with 
their performance on the state assessment by comparing how the school did on each measure in relation to the other LESCP schools in the state. 
In five of the seven states, there was good correlation between relative rankings by SAT-9 and relative rankings by state assessments. Thus, 
while SAT-9 does not map perfectly onto the content and skills measured by all states, it appeared to provide a good substitute for state 
assessments in the analysis of student achievement. 
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